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Amendments to the claims (this listing replaces all prior versions): 

1 . (Currently Amended) A machine-based method comprising: 

in connection with a project in which a user g e n e rates a predictive model is generated 
based on historical data about a system being modeled[[:]] 

selecting variables having at least a first predetermined level of significance from a pool 
of potential predictor variables associated with the historical data, to form a first population of 
predictor variables, 

extending the first population of predictor variables to include cross products of at least 
two variables, each being from the first population of predictor variables, 

selecting variables having at least a second predetermined level of significance from the 
extended first population of predictor variables to form a second population of predictor 
variables, 

extending the second population of predictor variables to include cross products of at 
least two variables, at least one of the variables being from the pool first population of predictor 
variables and having less than the first predetermined level of significance, 

selecting variables having at least a third predetermined level of significance from the 
extended second population of predictor variables to form a third population of predictor 
variables, 

automatically selecting a model generation method from a set of available model 
generation methods to match characteristics of the historical data, 

generating a possible model of the third population of predictor variables using a 
subsample of the historical data by the model generation method, 

determining whether the possible model generalizes to the historical data other than the 
subsample, 

applying the possible model to all of the historical data to generate a final model, 
cross-validating the final model using random portions of the historical data, and 
interacting with the system being modeled based on the final model. 



Applicant 
Serial No. 
Filed 
Page 



Stephen K. Pinto et al. 
10/826,630 
April 16, 2004 
3 of 16 



Attorney's Docket No.: 17146-0007001 



2. (Currently Amended) The method of claim 1 also including displaying 
information to the auser of the size of the pool of potential predictor variables. 

3. (Previously Presented) The method of claim 1 also including enabling a user to 
point and click to reduce or extend the size of the pool of potential predictor variables, retaining 
only predictor variables having at least the second predetermined level of significance. 

4. (Currently Amended) The method of claim 1 in which the auser is enabled to 
invoke an automatic process to select a class of models most suitable to the pool of potential 
predictor variables associated with the historical data. 

5. (Currently Amended) The method of claim 1 in which fee a user is enabled to 
point and click to adjust a criterion of the model selection to retain only variables having at least 
a certain level of significance for a target goal. 

6. (Currently Amended) The method of claim 1 in which the a user is enabled to 
point and click to cause display of information about performance of the possible model or the 
final model. 

7. (Previously Presented) The method of claim 6 in which the information includes 
at least one of: a statistical report card, a link to a statistical report chart, a lift chart, a link to the 
lift chart, a response comparison chart for each decile for each predictor variable in the possible 
model or the final model, or a link to the response comparison chart. 

8. (Previously Presented) The method of claim 7 in which invocation of the link to 
the statistical report card causes display of the statistics of the performance of the possible model 
or the final model. 

9. (Original) The method of claim 7 in which invocation of the link to the lift chart 
causes display of a non-cumulative lift chart. 
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1 0. (Previously Presented) The method of claim 7 in which invocation of the link to 
the response comparison chart causes display of a response chart for each predictor variable in 
the possible model or the final model for each segment of interest. 

1 1 . (Previously Presented) The method of claim 1 in which a user is enabled to 
choose interactively at least one performance criterion change or transformation or interaction of 
variables to improve a fit of the possible model or the final model. 

12. (Canceled). 

13. (Currently Amended) The method of claim 1 in which the a user is enabled to 
select at least one validation dataset and invoke a model process validation method. 

14. (Previously Presented) The method of claim 13 in which the user is enabled to 
point and click to cause display of information about the model process validation. 

15. (Previously Presented) The method of claim 1 4 in which the information about 
the model process validation includes at least one of: a statistical report card, a link to a statistical 
report chart, a cumulative lift chart, a link to the cumulative lift chart, a non-cumulative lift chart, 
a link to the non-cumulative lift chart. 

1 6. (Currently Amended) The method of claim 1 in which the auser is enabled to 
select at least one machine automated model development process applied to the entire datas e t 
set of historical data for a validated model process. 

1 7. (Previously Presented) The method of claim 1 6 in which the user is enabled to 
point and click to cause display of information about the performance of the validated model 
process applied to the entire set of historical data. 



Applicant 
Serial No. 
Filed 
Page 



Stephen K. Pinto et al. 
10/826,630 
April 16, 2004 
5 of 16 



Attorney' s Docket No.: 17146-0007001 



18. (Previously Presented) The method of claim 17 in which the information about 
the performance comprises information about the performance of the validated model process 
applied to two independent data subsets, the independent data subsets being randomly selected 
from the historical data, and includes at least one of: a statistical report card, a link to a statistical 
report chart, a cumulative lift chart, a link to the cumulative lift chart, a non-cumulative lift chart, 
a link to the non-cumulative lift chart. 

1 9. (Original) The method of claim 1 8 in which the invocation of the link to the 
statistical report card causes display of the statistics of model process validation. 

20-21. (Canceled). 

22. (Original) The method of claim 18 in which the final model and the model 
process validation results are stored persistently. 

23. (Currently Amended) The method of claim 1 also including enabling the auser to 
observe the number of predictor variables available for generating the predictive model. 

24. (Canceled). 

25. (Currently Amended) The method of claim 1 also including enabling the auser to 
observe the performance of the possible model or the final model by means of links to a plurality 
of statistical and graphical reports. 

26. (Currently Amended) The method of claim 1 also enabling the a user to select a 
means of validating the selected model generation method. 

27. (Currently Amended) The method of claim 1 also including enabling the auser to 
observe the performance of the possible model or the final model when applied to a training 
subset and a validation subset of the historical data. 
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28. (Currently Amended) The method of claim 1 also including enabling the auser to 
invoke at least one validated model generation method to produce a final model and enabling the 
user to observe performance of the final model on at least two independent subsets, the 
independent subsets being randomly selected from the historical data. 

29. (Previously Presented) The method of claim 1 also including enabling the 
persisting of the final model and intermediate results to a project database. 

30. (Currently Amended) The method of claim 1 also including enabling the final 
model to be applied to scoring at least one non-historical dataset wherein the a propensity 
computed by the model is indexed by the score. 

3 1 . (Previously Presented) A machine-based method comprising: 
in connection with a project, 

automatically selecting a model generation method from a set of available model 
generation methods to match characteristics of historical data about a system being modeled, 
generating a predictive model based on the historical data, and 
displaying to a user a lift chart, monotonicity, and concordance scores associated with 
each step in a step-wise model fitting process, the concordance scores being obtained based on a 
receiver-operator-characteristic curve and indicating to the user goodness of fit of the historical 
data to the generated predictive model. 

32. (Previously Presented) The method of claim 3 1 also including enabling the user to 
observe changes in the fit as variables associated with the historical data are added or removed 
from a predictor set of the variables. 

33. (Previously Presented) The method of claim 3 1 also including enabling the user to 
terminate the fitting process when the fitting process reaches an optimal point. 
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34. (Currently Amended) A machine-based method comprising! 

receiving from separate sources, sets of potential predictor and dependent variables 
representing historical data about a system being modeled, and 

enabling a user of a model generation tool to combine at least two models based on 
response propensities of each model in order to create cross-modal deciles and based on data 
weaving of the historical data to provide cross-modal optimization, the combining including 
concatenating the predictions of the two models. 

35. (Previously Presented) The method of claim 34 in which enabling the user to 
combine the models includes providing a user interface that enables the user to identify variables 
to be combined. 

36. (Previously Presented) The method of claim 34 in which the system being 
modeled comprises behavior of prospective or current customers with respect to products or 
services of a company and the method also includes adjusting outcome variables to normalize 
response rates across products or services with different response rates. 

37. (Previously Presented) The method of claim 34 in which the system being 
modeled comprises behavior of current customers with respect to retention of a current service or 
product of a vendor and the method also includes adjusting variables to normalize response rates 
across products or services with different response rates, using computed propensities as indices 
of the scores. 

3 8 . (Previously Presented) The method of claim 34 also comprising determining a 
course of action to yield the most positive net present value outcome. 

39. (Original) The method of claim 38 in which the determining includes selection of 
a mix of channel and product combinations. 



Applicant : Stephen K. Pinto et al. Attorney's Docket No.: 17146-0007001 

Serial No. : 10/826,630 

Filed : April 16,2004 

Page : 8 of 16 



40. (Previously Presented) The method of claim 38 in which the determining includes 
predicting retention in combination with response rate to predict net present value. 



